Haptic feedback device and method for providing haptic sensation based on video

ABSTRACT

A haptic feedback device for providing haptic sensation comprises a haptic feedback interface that includes a plurality of haptic elements. The haptic feedback device detects a speed and a direction of travel associated with a plurality of moving objects in an upcoming scene of a video based on a look-ahead buffer of the video played on an external display device or the haptic feedback device. A haptic feedback is determined for the upcoming scene of the video based on the look-ahead buffer of the video and the detected speed and direction of travel associated with the plurality of moving objects. One or more movable haptic cues are generated on the haptic feedback interface using the plurality of haptic elements in synchronization with a current scene played on the external display device or the haptic feedback device, based on the determined haptic feedback.

CROSS-REFERENCE TO RELATED APPLICATIONS/INCORPORATION BY REFERENCE

This patent application makes reference to, claims priority to, claimsthe benefit of, and is a Continuation Application of U.S. patentapplication Ser. No. 17/460,460, filed Aug. 30, 2021, which is aContinuation Application of U.S. Pat. No. 11,175,740, issued Nov. 16,2021, which is a Continuation Application of U.S. Pat. No. 10,754,429,issued Aug. 25, 2020, which is a Continuation Application of U.S. Pat.No. 10,496,176, issued on Dec. 3, 2019, which is a ContinuationApplication of U.S. Pat. No. 10,281,983, issued on May 7, 2019.

Each of the above referenced applications is hereby incorporated hereinby reference in its entirety.

FIELD

Various embodiments of the disclosure relate to haptic technologies.More specifically, various embodiments of the disclosure relate to ahaptic feedback device and method to provide haptic sensation based onvideo.

BACKGROUND

Humans have five traditional recognized senses, sight(ophthalmoception), hearing (audioception), taste (gustaoception), smell(olfacoception or olfacception), and touch (tactioception). The loss ofone or more senses generally results in enhancement of one or more ofthe remaining senses to compensate for the lost sense(s). Currently,technological developments in human-machine interaction (HMI) are mostlyfocused on vision-based interaction technology. Touch-sense basedtechnologies still remains underexplored. For example, existingtechnology are typically focused on Braille-based or other rudimentaryforms of tactile presentation systems, such as raised dots or spikes. Itis known that the sense of touch has a much greater sensory resolutionthan the sense of sight. Hence, the sense of touch can detect even smallchanges on a surface that the eye cannot detect. Thus, a technologicallyadvanced haptic feedback device may be required to provide enhancedhaptic sensation to a user to improve user experience, for example, inentertainment, gaming, and overall understanding of the world byextended exploration of the human touch-sense.

Further limitations and disadvantages of conventional and traditionalapproaches will become apparent to one of skill in the art, throughcomparison of described systems with some aspects of the presentdisclosure, as set forth in the remainder of the present application andwith reference to the drawings.

SUMMARY

A haptic feedback device and a method to provide haptic sensation basedon video substantially as shown in, and/or described in connection with,at least one of the figures, as set forth more completely in the claims.

These and other features and advantages of the present disclosure may beappreciated from a review of the following detailed description of thepresent disclosure, along with the accompanying figures in which likereference numerals refer to like parts throughout.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an exemplary environment for providing hapticsensation by a haptic feedback device based on video, in accordance withan embodiment of the disclosure.

FIG. 2A is a block diagram that illustrates an exemplary haptic feedbackdevice for providing haptic sensation, in accordance with an embodimentof the disclosure.

FIG. 2B illustrates exemplary protrusions and depressions on a hapticfeedback interface of the haptic feedback device of FIG. 2A forproviding haptic sensation, in accordance with an embodiment of thedisclosure.

FIG. 3 illustrates a first exemplary scenario for implementation of theexemplary haptic feedback device of FIG. 2A for providing hapticsensation in a haptic television mode, in accordance with an embodimentof the disclosure.

FIG. 4 illustrates a second exemplary scenario for implementation of theexemplary haptic feedback device of FIG. 2A for providing hapticsensation in a haptic gaming mode, in accordance with an embodiment ofthe disclosure.

FIG. 5 illustrates a third exemplary scenario for implementation of theexemplary haptic feedback device of FIG. 2A for providing hapticsensation in an augmented gaming mode, in accordance with an embodimentof the disclosure.

FIGS. 6A, 6B, and 6C collectively, depict a flow chart that illustratesa method for providing haptic sensation, in accordance with anembodiment of the disclosure.

DETAILED DESCRIPTION

The following described implementations may be found in the disclosedhaptic feedback device and method for providing haptic sensation. Thedisclosed haptic feedback device provides enhanced haptic sensation to auser to improve the user experience, for example, in entertainment,gaming, and overall understanding of the world. The disclosed hapticfeedback device harnesses the non-visual senses, such as the sense oftouch and hearing, to provide enhanced haptic sensation to users toprovide enhanced user experience, for example, in haptic gaming andother forms of entertainment by exploring the touch-sense of the users.In some embodiments, the haptic feedback device may be utilized by usersthat are visually impaired. In some embodiments, the haptic feedbackdevice may also be used by sighted people to gain unfamiliar andsupplementary experiences by exploring their touch-sense in extendedmanner in additional to the visual sense. In some embodiments, thehaptic feedback device may be used by both a sighted user and a visuallyimpaired user at the same time.

FIG. 1 illustrates an exemplary environment for providing hapticsensation by a haptic feedback device based on video, in accordance withan embodiment of the disclosure. With reference to FIG. 1 , there isshown an exemplary environment 100. The exemplary environment 100 mayinclude a haptic feedback device 102, a display device 104, acommunication network 106, and one or more users, such as a user 110.The haptic feedback device 102 may include a haptic feedback interface108 and a mode selector 114. A video 112 may be played on the displaydevice 104. The haptic feedback device 102 may be communicativelycoupled to the display device 104 via the communication network 106.

The haptic feedback device 102 may include suitable logic, circuitry,and/or code to generate a plurality of different haptic cues on thehaptic feedback interface 108. The plurality of different haptic cuesmay be generated based on the video 112 played on an external displaydevice (such as the display device 104) or the haptic feedback device102. Examples of implementation of the haptic feedback device 102 mayinclude, but are not limited to a special-purpose portable hapticfeedback device, a special-purpose gaming suit, special-purpose handgloves, special-purpose shoes, a haptic gaming device, or a wearabledevice that may be worn at different parts of human body.

The display device 104 may include suitable logic, circuitry, and/orcode that may be configured to play or render a video (such as the video112). Examples of the display device 104 may include, but are notlimited to a television, a set-top box, a gaming console, a laptopcomputer, a smartphone, a video player, such as a Blu-ray Disc (BD)player or a DVD player, a projector, or other display devices.

The communication network 106 may be a medium that may enablecommunication between the haptic feedback device 102 and the displaydevice 104. The communication network 106 may be implemented by one ormore wired or wireless communication technologies known in the art. Insome embodiments, the communication network 106 may refer to ashort-range or medium-range wireless communication network. In someembodiments, the communication network 106 may refer to a long rangecommunication network. Examples of short-range or medium-range wirelesscommunication networks may include, but are not be limited to, aWireless-Fidelity (Wi-Fi) based network, a Light-Fidelity (Li-Fi) basednetwork, a wireless personal area network (WPAN) such as a BLUETOOTH™network, Internet-of-Things (IoT) network, Machine-Type-Communication(MTC) network, and/or a Wi-Max based network. Examples of the long rangecommunication networks may include, but not limited to, the Internet, acloud network, a wireless wide area network (WWAN), a Local Area Network(LAN), a plain old telephone service (POTS), a Metropolitan Area Network(MAN), or a cellular or mobile network, such as Global System for MobileCommunications (GSM), General Packet Radio Service (GPRS), Enhanced DataRates for GSM Evolution (EDGE), 1G, 2G, 3G, 4G Long Term Evolution(LTE), 5G, IEEE 802.11, 802.16, and the like.

The haptic feedback interface 108 may comprise a plurality of hapticelements. In accordance with an embodiment, the haptic feedbackinterface 108 may refer to a haptic output interface configured toprovide at least a touch-discernible output to the user 110. In someembodiments, the haptic feedback interface 108 may refer to a hapticinput/output (I/O) interface configured to receive haptic input as wellas provide haptic output to the user 110 from the same haptic I/Ointerface. It is known that the sense of touch has a much greatersensory resolution than the sense of sight. Hence, the sense of touchcan detect even small changes on a surface that the eye cannot detect.This principle of the sense of touch may be used to guide the design ofthe haptic feedback interface 108.

In some embodiments, the user 110 may be a person who have lost orimpaired the sense of sight. The user 110 may want to understand andexperience television programs, or different videos, such as a movie, orplay video games, or learn and understand about the surrounding world.It is known that sighted people visualize the surrounding world bydetection of edges between areas of different wavelengths of light,which is then perceived as different colors by the brain. Based onfeedback from the visual system, the visual part of the brain referredto as visual cortex, processes visual information of the surroundingworld to enable the sighted people to visualize the surrounding world.It is also known that the loss of one or more senses, such as the senseof sight, generally results in enhancement of one or more of theremaining senses, such as sense of touch, hearing, smell, or taste, tocompensate for the lost sense(s). The haptic feedback device 102harnesses the non-visual senses, such as the sense of touch, hearing, orsmell, to provide enhanced haptic sensation to users, such as the user110, who have lost or impaired the sense of sight to provide enhanceduser experience, for example, in haptic gaming and other forms ofentertainment by exploring the touch-sense of the users. In someembodiments, the haptic feedback device 102 may also be used by sightedpeople to gain unfamiliar and supplementary experiences by exploringtheir touch-sense in extended manner in additional to the visual sense.In some embodiments, the haptic feedback device may be used by both asighted user and a visually impaired user at the same time (e.g. asdiscussed in FIG. 4 )

The video 112 may be played by the display device 104 which may be anexternal device. In some embodiments, the video 112 may be played in thehaptic feedback device 102. The video 112 may refer to televisionprogramming, a commercial, a promo, a movie, a news program, and thelike. The video 112 may also refer to a single user or a multi-useronline or offline video game, or other types or kinds of video.

The mode selector 114 may refer to a hardware mode selector, such as abutton or a wheel, which may be used by a user (such as the user 110) toselect a mode from one of a haptic television (TV) mode, a haptic gamingmode, or an augmented gaming mode. The haptic TV mode may be set in thehaptic feedback device 102 to enable a visually impaired user tonon-visually discern and experience the video 112, for example, a TVprogram, by touch sense based on the generated plurality of differenthaptic cues on the haptic feedback interface 108 and audio. An exampleof the implementation of the haptic TV mode is described, for example,in FIG. 3 . The haptic gaming mode may be set in the haptic feedbackdevice 102 to enable a visually impaired user or a sighted user (i.e. auser who have not lost the sense of sight) to play a video game bydiscerning the video game by touch sense based on the generatedplurality of different haptic cues on the haptic feedback interface 108and audio. An example of the implementation of the haptic gaming mode isdescribed, for example, in FIG. 4 . The augmented gaming mode may be setin the haptic feedback device 102 to enable a user (i.e. either asighted user or a visually impaired user) to experience different hapticsensation based on a video game played at a gaming console or ahead-mounted device. The different haptic sensation may be experiencedbased on one or more haptically-augmented features generated on thehaptic feedback interface 108 at the time of playing of the video game.The one or more haptically-augmented features may be different fromvisually perceptible elements present in a current scene of the videogame played at the gaming console or the head-mounted device. An exampleof the implementation of the augmented gaming mode is described, forexample, in FIG. 5 .

In operation, the haptic feedback device 102 may be configured to selecta mode from the haptic television mode, the haptic gaming mode, or theaugmented gaming mode, based on an input received from the mode selector114. The user 110 may select one of the haptic television mode, thehaptic gaming mode, or the augmented gaming mode using the mode selector114. The haptic feedback device 102 may be configured to receive alook-ahead buffer of an upcoming scene of the video 112 in real time ornear-real time from the display device 104. In cases where the video 112is played at the haptic feedback device 102, a video segment thatcorresponds to the upcoming scene of the video 112 may be accessed froma memory of the haptic feedback device 102.

The haptic feedback device 102 may be configured to detect a pluralityof different objects in the upcoming scene of the video 112 based on thelook-ahead buffer of the video 112. The haptic feedback device 102 maybe configured to identify an object-type of each of the plurality ofobjects in the upcoming scene of the video 112. The haptic feedbackdevice 102 may be configured to detect a plurality of different motionassociated with the plurality of objects in the upcoming scene of thevideo 112 based on the look-ahead buffer of the video 112 played on thedisplay device 104 or the haptic feedback device 102.

In accordance with an embodiment, the haptic feedback device 102 may beconfigured to determine a haptic feedback for the upcoming scene of thevideo 112 based on the look-ahead buffer of the video 112, the detectedplurality of different motion associated with the plurality of objects,and the selected mode. The haptic feedback device 102 may be configuredto generate a plurality of different haptic cues on the haptic feedbackinterface 108 using the plurality of haptic elements. The plurality ofdifferent haptic cues on the haptic feedback interface 108 may begenerated based on the determined haptic feedback and the selected mode.In some embodiments, the plurality of different haptic cues may includeone or more movable haptic cues. The plurality of different haptic cueson the haptic feedback interface 108 may be generated in synchronizationwith a current scene played on the display device 104 or the hapticfeedback device 102, based on the determined haptic feedback.

In cases where the selected mode is the haptic TV mode, the hapticfeedback device 102 may be configured to selectively reproduce thecurrent scene played on the display device 104 or the haptic feedbackdevice 102 on the haptic feedback interface 108, based on the determinedfeedback. An example of the selective reproduction of the current scenein the haptic TV mode is shown and described, for example, in FIG. 3 .

In cases where the selected mode is the haptic gaming mode, the hapticfeedback device 102 may be configured to detect a haptic input on thehaptic feedback interface 108, based on a press or a push on at leastone of the generated plurality of different haptic cues that includesthe one or more movable haptic cues. In the haptic gaming mode, theoutput of an audio feedback by the haptic feedback device 102 may becontrolled to be in sync with the generated plurality of haptic cues. Anexample of the detection of the haptic input in the haptic gaming modeand control of audio output is described, for example, in FIG. 4 .

In cases where the selected mode is the augmented gaming mode, thehaptic feedback device 102 may be configured to generate at least ahaptically-augmented feature on the haptic feedback interface 108. Thehaptically-augmented feature may be different from the visuallyperceptible elements in the current scene of the video 112. Thehaptically-augmented feature may be discernible by tactioception throughthe haptic feedback interface 108 that may be worn as a gaming suit. Anexample of the haptically-augmented feature that may be sensed throughthe haptic feedback interface 108 is shown and described, for example,in FIG. 5 .

The somatic sensory system of human body is responsible for the sense oftouch and has sensory touch or pressure receptors that enable a human todetect and feel when something comes into contact with skin. The senseof touch may also be referred to as somatic senses or somesthetic sensesthat include proprioception (e.g. sense of position and movement) orhaptic perception. Typically, such sensory receptors for sense of touchare present, for example, on the skin, epithelial tissues, muscles,bones and joints, and even on certain internal organs of the human body.Thus, various haptic sensations may be provided to the human body in thehaptic TV mode, the haptic gaming mode, and the augmented gaming mode bythe haptic feedback device 102, as further described in details, forexample, in FIGS. 2A, 2B, 3, 4, 5, 6A, 6B, and 6C.

FIG. 2A is a block diagram that illustrates an exemplary haptic feedbackdevice for providing haptic sensation, in accordance with an embodimentof the disclosure. FIG. 2A is explained in conjunction with elementsfrom FIG. 1 . With reference to FIG. 2A, there is shown the hapticfeedback device 102. The haptic feedback device 102 may include aprocessing section 202, a sensor section 204, and a user interfacesection 206. The processing section 202 may include a network interface208, a processing circuitry 210, and a memory 212. The memory mayinclude a portion, referred to as a video buffer 212A, for temporarystorage and processing of look-ahead buffer of the video 112. The sensorsection 204 may include a plurality of microphones 214 and a sensorcluster unit 216. The sensor cluster unit 216 may include at least abiometric sensor 216A. The user interface section 206 may include thehaptic feedback interface 108, a haptic feedback controller 220, and oneor more audio-output devices, such as a first audio-output device 224Aand a second audio-output device 224B, and the mode selector 114. Thehaptic feedback interface 108 may include a plurality of haptic elements218. The haptic feedback controller 220 may include a haptic feedbackgenerator 222.

In accordance with an embodiment, the haptic feedback device 102 may becommunicatively coupled to an external device, such as the displaydevice 104, through the communication network 106, by use of the networkinterface 208. The processing circuitry 210 may be communicativelycoupled to the memory 212, and the various components of the sensorsection 204 and the user interface section 206, via a system bus.

The network interface 208 may comprise suitable logic, circuitry,interfaces, and/or code that may be configured to receive look-aheadbuffer of the video 112 played on the external device or the hapticfeedback device 102. The network interface 208 may be further configuredto communicate with external devices, such as the display device 104,via the communication network 106. The network interface 208 mayimplement known technologies to support wireless communication. Thenetwork interface 208 may include, but are not limited to, a transceiver(e.g. a radio frequency (RF) transceiver), an antenna, one or moreamplifiers, a tuner, one or more oscillators, a digital signalprocessor, a coder-decoder (CODEC) chipset, a subscriber identity module(SIM) card, and/or a local buffer.

The network interface 208 may communicate via wireless communicationwith networks, such as the Internet, an Intranet and/or a wirelessnetwork, such as a cellular telephone network, a wireless local areanetwork (WLAN), a personal area network, and/or a metropolitan areanetwork (MAN). The wireless communication may use any of a plurality ofcommunication standards, protocols and technologies, such as GlobalSystem for Mobile Communications (GSM), Enhanced Data GSM Environment(EDGE), wideband code division multiple access (W-CDMA), code divisionmultiple access (CDMA), LTE, time division multiple access (TDMA),BLUETOOTH™, Wireless Fidelity (Wi-Fi) (such as IEEE 802.11a, IEEE802.11b, IEEE 802.11g, IEEE 802.11n, and/or any other IEEE 802.11xprotocol), voice over Internet Protocol (VoIP), Wi-MAX,Internet-of-Things (IoT) technology, Li-Fi, Machine-Type-Communication(MTC) technology, a protocol for email, instant messaging, and/or ShortMessage Service (SMS).

The processing circuitry 210 may refer a digital signal processor (DSP).The processing circuitry 210 may comprise suitable logic, circuitry,interfaces, and/or code that may be configured to detect a plurality ofdifferent motion associated with a plurality of objects in an upcomingscene of the video 112 based on the look-ahead buffer of the video 112played on the external device or the haptic feedback device 102. Thehaptic feedback device 102 may be a programmable device, where theprocessing circuitry 210 may execute instructions stored in the memory212. Other implementation examples of the processing circuitry 210 mayinclude, but are not limited to a specialized DSP, a Reduced InstructionSet Computing (RISC) processor, an Application-Specific IntegratedCircuit (ASIC) processor, a Complex Instruction Set Computing (CISC)processor, and/or other processors.

The memory 212 may comprise the video buffer 212A and a learning engine.The processing circuitry 210 may be configured to determine one or morepatterns in a plurality of user interactions on the haptic feedbackinterface 108 over a period of time based on a track of a usage patternof the haptic feedback device 102 by the learning engine. The memory 212may include suitable logic, circuitry, and/or interfaces that may beconfigured to store a set of instructions executable by the processingcircuitry 210. The memory 212 may be further configured to temporarilystore one or more video segments in the video buffer 212A for real timeor near-real time processing of the video data of the video 112. Thememory 212 may also store usage history, an amount of pressure exertedby the user 110 while touching the haptic feedback interface 108 in theplurality of user interactions on the haptic feedback interface 108 overa period of time. The memory 212 may also store input and outputpreference settings by the user 110. Examples of implementation of thememory 212 may include, but not limited to, a random access memory(RAM), a dynamic random access memory (DRAM), a static random accessmemory (SRAM), a thyristor random access memory (T-RAM), azero-capacitor random access memory (Z-RAM), a read only memory (ROM), ahard disk drive (HDD), a secure digital (SD) card, a flash drive, cachememory, and/or other non-volatile memory.

The plurality of microphones 214 may comprise suitable circuitry and/orinterfaces to receive an audio input. In accordance with an embodiment,the audio input may be provided by the user 110. The audio input maycorrespond to a voice input to the haptic feedback device 102. Inaccordance with an embodiment, the plurality of microphones 214 may bemuted or disabled in accordance with user preferences. The plurality ofmicrophones 214 may capture sound emanating in proximity of the user 110of the haptic feedback device 102.

The sensor cluster unit 216 may include a biometric sensor 216A, such asa fingerprint sensor, to decipher the identity of a user, such as theuser 110. In certain scenarios, the haptic feedback device 102 may beused by multiple users, for example, users of a same family, or group.In such a case, based on user authentication by use of the biometricsensor, a different usage profile and user settings may be loaded fordifferent users. In some embodiments, the sensor cluster unit 216 mayalso include a temperature sensor and a pressure sensor to gaugepressure applied by a user, such as the user 110, on the haptic feedbackinterface 108. In some embodiments, the sensor cluster unit 216 mayinclude the location sensor, an image sensor, a radio frequency (RF)sensor, an accelerometer, a gyroscope, a compass, a magnetometer, anintegrated image-capture device, a depth sensor, an altimeter, a luxmeter, an ultrasound sensor, an IR sensor, or one or more weathersensors.

The haptic feedback interface 108 may comprise the plurality of hapticelements 218. The plurality of haptic elements 218 may refer to an arrayof cylindrical tubes arranged at the surface of the haptic feedbackinterface 108. A person of ordinary skill in the art may understand thatthe shape of each tube may be variable, such as conical, hexagonal, orother polygonal shapes, without departing from the scope of thedisclosure. In accordance with an embodiment, the plurality of hapticelements 218 may be arranged as a layer (of array of cylindrical tubes)on the haptic feedback generator 222 such that a haptic signal may begenerated by the haptic feedback generator 222 through each of theplurality of haptic elements 218. In accordance with an embodiment, oneend (e.g. a proximal end) of each tube of the array of cylindrical tubesmay be coupled to the haptic feedback generator 222, and the other end(e.g. a distal end) may be interspersed on the haptic feedback interface108 such that a plurality of differential touch-discernible cuesgenerated by the haptic feedback generator 222 in conjunction with theplurality of haptic elements 218 are discernible on the haptic feedbackinterface 108 by the sense of touch.

The haptic feedback controller 220 may comprise suitable circuitry andinterfaces to determine a haptic feedback for the upcoming scene of thevideo 112 based on the look-ahead buffer of the video 112, the detectedplurality of different motion associated with the plurality of objects,and the selected mode. In some embodiments, the haptic feedbackcontroller 220 may be configured to sense a haptic user input viaplurality of haptic elements 218 based on a defined amount of pressuredetected at one or more haptic elements of the plurality of hapticelements 218. For example, the haptic user input may be sensed in thehaptic gaming mode to receive user input via the haptic feedbackinterface 108. The haptic feedback controller 220 includes the hapticfeedback generator 222. The haptic feedback generator 222 may beconfigured to generate one or more movable haptic cues on the hapticfeedback interface 108 using the plurality of haptic elements 218 insynchronization with a current scene played on the external device (suchas the display device 104) or the haptic feedback device 102, based onthe determined haptic feedback. The haptic feedback generator 222further generates a plurality of different haptic cues that includes theone or more movable haptic cues under the control of the haptic feedbackcontroller 220. The haptic feedback generator 222 may include one ormore differential pressure generating units, differential electric pulsegenerating units, shape-pattern extension and retraction units,differential temperature generating units, and a level of protrusionsetter to control elevation of raised shape patterns, such as spikesthrough the plurality of haptic elements 218. The haptic feedbackgenerator 222 may be configured to generate the plurality of differenthaptic cues by use of one or more of the differential pressuregenerating units, differential electric pulse generating units,shape-pattern extension and retraction units, differential temperaturegenerating units, and the level of protrusion setter to controlelevation of raised shape pattern.

The one or more audio-output devices 224, such as the first audio-outputdevice 224A and the second audio-output device 224B, may comprisesuitable circuitry and/or interfaces to generate an audio output for theuser 110. In accordance with an embodiment, the audio output may begenerated in-sync with the touch-discernible haptic output, such as theplurality of different haptic cues, on the haptic feedback interface108. In accordance with an embodiment, the audio output may be generatedin-sync with a haptic input received on the haptic feedback interface108 in the haptic gaming mode for enhanced understanding of the videogame played on the external device or the haptic feedback device 102.The haptic input may be detected by the haptic feedback controller 220by use of the pressure sensor of the sensor cluster unit 216. Inaccordance with an embodiment, the one or more audio-output devices 224may be muted or disabled based on a time-of-day or for a specificlocation, such as a public library where silence is solicited. AlthoughFIG. 2A illustrates two audio-input devices, a person of ordinary skillin the art may understand that the haptic feedback device 102 mayinclude a single audio-input device, or more than two audio-inputdevices.

Each of the one or more wearable pads 226 may refer to a suitable padthat acts as a substrate for the haptic feedback device 102. Each of theone or more wearable pads 226 may be water-resistant pads suitable to beworn on different parts of the human body, such as forearms, limbs,waist, or as a complete clothing item, such as the gaming suit 226B. Anexample of the gaming suit 226B is shown in FIG. 5 . In accordance withan embodiment, each of the one or more wearable pads 226 may be designedsuch that the haptic feedback interface 108 may be in contact to theskin of the human body. The pad fasteners 228 refer to detachablefasteners that allow the two terminal portions of each of the one ormore wearable pads 226 to detachably affix with each other. Examples ofthe pad fasteners 228 may include, but are not limited to clips, hookand loop fastener, detachable straps, buttons, and the like.

The gaming suit 226B may refer to a complete or partial body suit thatmay be worn by the user 110 while playing a video game. The innersurface of the gaming suit 226B may embed the haptic feedback interface108 such that a haptically-augmented feature generated on the hapticfeedback interface 108 may be sensed by the skin of the user 110.Examples of the gaming suit 226B, may include a gaming vest, a gamingjacket, a complete body suit, or a clothing item where the hapticfeedback interface 108 may be embedded. An example of the gaming suit226B is shown and described in FIG. 5 .

The various operations of the haptic feedback device 102 described inFIG. 1 may be performed by the different components of the hapticfeedback device 102, as described in FIG. 2A. The various operations orfunctions of the different components of the haptic feedback device 102may be further understood, for example, from FIGS. 2B, 3, 4, 5, 6A, 6B,and 6C.

FIG. 2B illustrates exemplary protrusions and depressions on a hapticfeedback interface of the haptic feedback device of FIG. 2A forproviding haptic sensation, in accordance with an embodiment of thedisclosure. FIG. 2B is described in conjunction with elements from FIGS.1 and 2A. With reference to FIG. 2B, there is shown a surface portion ofthe haptic feedback interface 108 with protrusions 230A to 230E, 232A,234A, and 236A at different time instants 238A to 238E. There is alsoshown a depression 240A on the haptic feedback interface 108 at thedifferent time instants 238A to 238D.

At time instant 238A, the protrusion 230A may be generated on thesurface portion of the haptic feedback interface 108 by the hapticfeedback generator 222. The protrusion 230A may be a haptic cuegenerated on the haptic feedback interface 108. At time instant 238B,the protrusion 230A (the same protrusion) may deform into a differentshape, as shown by the protrusion 230B. At a next time instant, such asthe time instant 238C, the protrusion 230B may deform further to anothershape, such as the protrusion 230C, or return to its original shape,such as the protrusion 230A. The same protrusion, such as the protrusion230A, may have different meanings based on the deformation (as indicatedby protrusions 230B, 230C, 230D, and 230E). The deformation may indicatean intra-movement related to an object in the video 112. For example, aperson standing in the video 112 may suddenly be seated. This change orintra-movement may be represented by the protrusion 230A that deforms toprotrusion 230D. In this case, the deformation may correspond to partialretraction of one or more haptic elements of the plurality of hapticelements 218 to change the level of elevation of the protrusion 230Afrom a first level to a second level. The second level of elevation maybe different than the first level of elevation. The protrusion 230E, forexample, shows a deformation of the protrusion 230A where the size ofthe protrusion 230A is reduced. Thus, the same protrusion may havedifferent meanings based on the deformation. In another example, theprotrusion 230A may be a constantly deforming protrusion (e.g. deformedfrom protrusion 230A to the protrusions 230B and 230C) at different timeinstants 238A, 238B, and 238C. Based on a touch on the constantlydeforming protrusion (such as the protrusion 230A), the user 110 maydiscern certain changes related to an object in the video 112. Forexample, movement in a water body may be represented by the protrusions230A, 230B, and 230C, which may be sensed by touch on the constantlydeforming protrusion.

In accordance with an embodiment, the plurality of different haptic cuesmay be generated as a plurality of protrusions of different shapes thatare extended from the surface of the haptic feedback interface 108. Forexample, the protrusions 230A, 232A, 234A, and 236A. The 232A may be astatic protrusion, which may not change its shape or location atdifferent time instants 238A to 238E, as shown. The protrusion 234A maybe round shaped protrusion generated at the time instant 238A but may beretracted at next time instants 238B to 238E. The protrusion 236A may bea new movable protrusion generated at the time instant 238C. Theprotrusion 236A may move or appear to move from its original position toa new position at different time instants, such as the time instant 238Dand 238E. This movement of protrusions may be used to indicateinter-movement of different detected objects in the video 112.

The generation of the plurality of protrusions of different shapes arealso shown, for example, as haptic cues 318 a, 320 a, 322 a, and 318 bin the haptic TV mode in the FIG. 3 and as haptic cues 406 a, 406 b, 408a, and 408 b in the haptic gaming mode in FIG. 4 . In accordance with anembodiment, the plurality of different haptic cues may also be generatedas a plurality of depressions of different shapes that are representedas concavities at the surface of the haptic feedback interface 108. Forexample, the depression 240A may be round shaped depression that isindicative of a pothole, a hole, or other concavities. The generation ofa combination of protrusions (e.g. haptic cues 406 b and 408 b) anddepressions (e.g. haptic cues 406 a and 408 a) are shown and described,for example, in FIG. 4 .

Different shapes generated by the haptic feedback generator 222, may notbe limited to the oval, round, square, triangle, and other shapes, forexample, any polygonal shapes or human-like shapes may be generatedbased on user-preference. In accordance with an embodiment, the shape ofa protrusion may be customized by users of the haptic feedback device102 in accordance with their needs or preferences. For example, a voicecommand may be provided by the user 110, for example, “generate astar-shaped pattern to represent a building”. At least one of pluralityof microphones 214 may capture the voice command. The processingcircuitry 210 may be configured to interpret the voice command andinstruct the haptic feedback controller 220 to generate a star-shapedprotrusion based on the interpreted voice command. The haptic feedbackcontroller 220 may be configured to generate the protrusion 232A, whichmay be in a customized shape, such as the star-shaped pattern. In someembodiments, the customization of shape patterns may be done via thehaptic feedback interface 108 using one or more software and/or hardwarecontrol buttons (not shown).

FIG. 3 illustrates a first exemplary scenario for implementation of theexemplary haptic feedback device of FIG. 2A for providing hapticsensation in a haptic television mode, in accordance with an embodimentof the disclosure. FIG. 3 is described in conjunction with elements fromFIGS. 1, 2A, and 2B. With reference to FIG. 3 , there is shown a firstexemplary scenario 300 that includes a television (TV) 302 and thehaptic feedback device 102. A video 304 may be played on the TV 302.There is shown a plurality of consecutive video segments (such as afirst segment 304A, a second segment 304B, and a third segment 304C) ofthe video 304. The first segment 304A includes a first sequence of imageframes that corresponds to a first scene 306 displayed on a displayscreen 302A of the TV 302. The second segment 304B includes a secondsequence of image frames that corresponds to a second scene 308 to bedisplayed on the display screen 302A of the TV 302. At the time ofprocessing of the first segment 304A of the video 304, such as a TVbroadcast program, to display a current scene, such as the first scene306, video data (such as the second segment 304B) related to an upcomingscene (such as the second scene 308), may be stored in advance as alook-ahead buffer 310 in the memory of the TV 302.

In accordance with the first exemplary scenario 300, there is furthershown a mode selector wheel 312, a learning unit 314, a microphone 316,and a plurality of different haptic cues, such as a first haptic cue 318a, a second haptic cue 320 a, a third haptic cue 322 a, and a fourthhaptic cue 318 b. There is also shown the haptic feedback interface 108and the plurality of haptic elements 218 of the haptic feedbackinterface 108. The haptic feedback device 102 may be communicativelycoupled to the TV 302 via a wireless connection, such as thecommunication network 106. In accordance with the first exemplaryscenario 300, the user 110 may be a visually impaired who may still wantto experience and non-visually discern a TV program, such as the video304, played on the TV 302. The user 110 may then select the haptic TVmode using the mode selector wheel 312. The mode selector wheel 312 maycorrespond to the mode selector 114 (FIG. 1 ). The video 304 may be adance show broadcast displayed on the TV 302.

The learning unit 314 may be a learning assistant for the user 110 thatmay assist the user 110 to learn not only the operation of the hapticfeedback device 102 but also help understand meaning of each haptic cueof the plurality of different haptic cues generated on the hapticfeedback interface 108. The learning unit 314 may be a detachablehardware component of the haptic feedback device 102. For example, theuser 110 may provide a haptic input on a haptic cue, for example, thefirst haptic cue 318 a, the second haptic cue 320 a, or the third hapticcue 322 a, generated on the haptic feedback interface 108 based on thevideo 304. The user 110 may press a protrusion (or a bulge) generated asthe haptic cue on the haptic feedback interface 108. Based on the amountof pressure exerted by the user 110 while touching the protrusion on thehaptic feedback interface 108, the press may be considered a hapticinput by the haptic feedback controller 220. In cases where the amountof pressure exerted by the user 110 on a particular point or aprotrusion on the haptic feedback interface 108 is greater than athreshold pressure value, the press of the protrusion (or a bulge) maybe considered a haptic input for that particular object detected in thevideo 304. A corresponding action related to the pressed protrusion maybe executed by the haptic feedback controller 220 in association withthe processing circuitry 210. For example, when the first haptic cue 318a is pressed, an audio output in combination with a Braille feedback maybe generated on the learning unit 314 to learn about the objectrepresented by the first haptic cue 318 a. For example, raised dots for“a dancing girl” may appear in Braille on the learning unit 314. Theremay be a more button 314A on the learning unit 314. A press of the morebutton 314A may present additional information about the dancing girl inthe video 304. For example, “this is a hip-hop dance form” may be outputas Braille feedback, as audio, or combination of both audio and theBraille feedback. This enables learning about the object-type, augmentedinformation about the object, an action in the video 304, the shapeassociated with the haptic cues, and other meanings in the learningperiod. Thus, the learning unit 314 acts as the learning assistant or aself-help haptic guide. After certain period of time, when the user 110may be acquainted with the usage of the haptic feedback device 102 orthe generated cues, the learning unit 314 may be detached or plugged outfrom the haptic feedback device 102.

In accordance with an embodiment, the network interface 208 may beconfigured to access the look-ahead buffer 310 of the upcoming scene(such as the second scene 308) of the video 304 when a current scene(such as the first scene 306) may be displayed on the display screen302A of the TV 302. The second segment 304B of the video 304 thatcorresponds to the upcoming scene (such as the second scene 308) may bereceived (or retrieved) in real time or near-real time from the TV 302,via the communication network 106.

The processing circuitry 210 of the haptic feedback device 102 may beconfigured to detect a plurality of different objects in the upcomingscene of the video 112 based on the look-ahead buffer 310 of theupcoming scene (such as the second scene 308) of the video 304. Forexample, in this case, the detected plurality of objects in the upcomingscene may be a stage, a plurality of chairs, and a plurality of humanbeings. The processing circuitry 210 may be further configured toidentity an object-type of each of the plurality of objects in theupcoming scene of the video 304 based the look-ahead buffer 310 of thevideo 304. For example, in this case, the object-type in the upcomingscene (such as the second scene 308) may be identified as a girl (genderand age identified), a stage, and an audience facing towards the girl.

The processing circuitry 210 may be further configured to detect theplurality of different motion associated with the plurality of objectsin the upcoming scene of the video 304 based on the look-ahead buffer310 of the video 304 played on the TV 302. Both intra-motion andinter-motion associated with the plurality of objects may be detected.The intra-motion of an object refers to movement within the object, suchas movement of different parts of an object while the object is standingor located at a particular place. For example, movement of limbs, waist,face, and the like, while a human being is standing at a place. Theinter-motion refers to movement of objects with respect to each other.For example, a human object or a car moving from one location to otheras detected in the video 304.

In accordance with an embodiment, the processing circuitry 210 may beconfigured to determine a relative position and height of each ofplurality of objects with respect to each other. For example, it may bedetected that the girl is dancing on the stage while the audience isviewing the dancing girl. Thus, different motion, relative position, andheight of each object may be determined for later use duringdetermination of a haptic feedback to be generated on the hapticfeedback interface 108. Further, the processing circuitry 210 may beconfigured to determine the speed and the direction of travel of eachmoving objects (such as the dancing girl in this case) of the pluralityof objects.

The haptic feedback controller 220 may be configured to determine ahaptic feedback for the upcoming scene (such as the second scene 308) ofthe video 304 112 based on the look-ahead buffer 310 of the video 304and the detected plurality of different motion associated with theplurality of objects. The haptic feedback controller 220 may beconfigured to determine a scaling factor based on an aspect ratio of thevideo 304 and a defined haptic output area of the haptic feedbackinterface 108. The defined haptic output area refers to a spatial areaof the haptic feedback interface 108 on which the determined hapticfeedback is to be generated. The scaling factor may be utilized to mapthe detected plurality of objects to the plurality of haptic elements218 of the haptic feedback interface 108.

The haptic feedback generator 222 may be configured to generate theplurality of different haptic cues (such as the first haptic cue 318 a,the second haptic cue 320 a, and the third haptic cue 322 a) on thehaptic feedback interface 108 using the plurality of haptic elements218, based on the determined haptic feedback for the haptic TV mode. Insome embodiments, the plurality of different haptic cues may include oneor more movable haptic cues, such as the first haptic cue 318 a. Thefirst haptic cue 318 a corresponds to the detected dancing girl in thevideo 304. The second haptic cue 320 a corresponds to the detectedstage. The third haptic cue 322 a may correspond to the detectedaudience facing towards the dancing girl.

The haptic feedback generator 222 may be configured to generate the oneor more movable haptic cues on the haptic feedback interface 108 usingthe plurality of haptic elements 218 in synchronization with a currentscene played on the external display device (such as the display device104) or the haptic feedback device 102, based on the determined hapticfeedback. The one or more movable haptic cues may be generated on thehaptic feedback interface 108 at a time instant when the second scene308 (i.e. the upcoming scene for which the haptic feedback wasdetermined) is displayed (or played) as the current scene on the TV 302.Thus, the generated plurality of different haptic cues (such as thefirst haptic cue 318 a, the second haptic cue 320 a, and the thirdhaptic cue 322 a) on the haptic feedback interface 108 may be constantsynchronized with the current scene played on the TV 302. The pluralityof different haptic cues (such as the first haptic cue 318 a, the secondhaptic cue 320 a, and the third haptic cue 322 a) may be generated by atouch-discernible modality. The touch-discernible modality may includeat least one of a differential pressure-based modality, a differentialtemperature-based modality, a differential electric pulse-basedmodality, a differential raised shape pattern-based modality, or acombination of different touch-discernible modalities.

The differential pressure-based modality refers to generation of theplurality of different haptic cues as multi-level pressure or differentamount of pressure on the haptic feedback interface 108. A user, such asthe user 110, may feel different amount of pressure at different points(or portions) on the haptic feedback interface 108, which enables theuser 110 to discern certain characteristics, for example, positioning orobject-type of the plurality of objects, of the video 304 by touch onthe haptic feedback interface 108. Similarly, the differentialtemperature-based modality refers to generation of the plurality ofdifferent haptic cues as different temperatures, for example, differentcombination of hot and cold temperatures, on the haptic feedbackinterface 108. The different level of temperature may enable the user110 to discern, certain characteristics, for example, positioning orobject-type of the plurality of objects, of the video 304 (e.g. the TVprogram) by touch on the haptic feedback interface 108. The differentialelectric pulse-based modality refers to generation of the plurality ofdifferent haptic cues as different level of electric-pulses on thehaptic feedback interface 108. The different level of electric-pulsesmay enable the user 110 to feel, certain characteristics, for example,positioning or object-type of the plurality of objects, of the video 304by touch on the haptic feedback interface 108. The different level ofelectric-pulses may be felt as different amount of pain or prickingpoints. The differential raised shape pattern-based modality refers togeneration of the plurality of different haptic cues as a plurality ofprotrusions of different shapes that may be extended from the surface ofthe haptic feedback interface 108, as shown. Each protrusion may be araised shape-pattern or a bulge that may stick out from at least one ora group of haptic elements of the plurality of haptic elements 218 ofthe haptic feedback interface 108. The plurality of protrusions, such asthe first haptic cue 318 a, the second haptic cue 320 a, and the thirdhaptic cue 322 a) may represent the plurality of objects of the video304 (as displayed in the current scene of the video 304).

In accordance with an embodiment, the haptic feedback generator 222 maybe configured to control a relative positioning of the plurality ofdifferent haptic cues on the haptic feedback interface 108 toselectively reproduce the current scene (such as the second scene 308)played on the TV 302. The selective reproduction of the current scene(i.e. second scene 308) may correspond to removal of one or moreirrelevant objects detected in the video 304 (e.g. the TV program). Therelevancy and irrelevancy of each object of the detected plurality ofobjects may be estimated based on a predicted interest quotient for eachof the plurality of objects or a screen size occupied by an object inthe current scene displayed on the display screen 302A. For example, theplurality of chairs on which the audiences may be seated may be assignedthe least interest quotient among other objects of the plurality ofobjects. The objects, for which the predicted interest quotient is belowa defined threshold value, may be considered as irrelevant. Removal ofirrelevant objects detected in the look-ahead buffer 310 of the video304 for selective reproduction of the current scene (i.e. second scene308), may significantly save the processing time and battery powerconsumption for the generation of the plurality of different haptic cueson the haptic feedback interface 108.

In accordance with an embodiment, the haptic feedback generator 222 maybe configured to control deformation of a haptic cue, such as the firsthaptic cue 318 a, on the haptic feedback interface 108 such that anintra-movement of an object (e.g. the movement of limbs of the dancinggirl) may be discernible by tactioception. For example, the first hapticcue 318 a may be a movable haptic cue generated as a protrusion of ahuman-like shape-pattern extending from the haptic feedback interface108. The one or more motion from the detected plurality of differentmotion associated with the dancing girl in the upcoming scene of thevideo 304 may be discernible based on a movement of the deformation ofthe first haptic cue 318 a on the haptic feedback interface 108. Thefourth haptic cue 318 b is an example of the deformation of the firsthaptic cue 318 a to non-visually discern the intra-movement of thedancing girl. In this case, the intra-movement refers to dance movesperformed standing at same position.

In accordance with an embodiment, the haptic feedback generator 222 maybe configured to control movement of the one or more movable cues on thehaptic feedback interface 108 such that an inter-movement among a set ofmoving objects of the plurality of objects, which may be discernible bytactioception. In some embodiments, a rate-of-change of movement of theone or more movable haptic cues may be further controlled in accordancewith the determined scaling factor. For example, when the dancing girlmoves to a different position on the stage, the first haptic cue 318 amay move in-synchronization to the moment of the dancing girl in thevideo 304 displayed on the display screen 302A.

Similar to sighted people (i.e. people who have not lost sense of sight)who use information about the features on the surface of an object, likecolor, shading, or overall size, and shape, to recognize an object, thepeople who have lost the sense of sight may also identify anobject-type, object position, and motion associated with an object inthe video 304 based on a touch on the protrusions of different shapes,such as the first haptic cue 318 a, the second haptic cue 320 a, and thethird haptic cue 322 a, where an association of a particular shape andmotion with a particular object-type may be learned by the brain. Forexample, in this case, a zig-zag shaped haptic cue (i.e. the thirdhaptic cue 322 a) is indicative of audience, a human-shaped haptic cue(i.e. the first haptic cue 318 a and the fourth haptic cue 318 b) may beindicative of a human (such as the dancing girl), a horizontal line(i.e. the second haptic cue 320 a) may be indicative of a stage.Notwithstanding, different shapes generated by the haptic feedbackgenerator 222, may not be limited to the shapes shown in the FIG. 3 ,and other shapes, such as oval, round (e.g. the protrusion 234A),square, or triangle (e.g the protrusion 236A) or any polygonal shapes(e.g. the protrusion 232A (FIG. 2B) may be generated. In accordance withan embodiment, the shape of a protrusion may be customized by users ofthe haptic feedback device 102 in accordance with their needs orpreferences, as described for example, in FIG. 2B.

In certain scenarios, a user of the haptic feedback device 102 may notbe able to use all the five fingers of a hand while touching the hapticfeedback interface 108. This may be due to one or more missing fingers,restricted movement as a result of injury in one or more fingers, anailment, some bone fracture, or pain. In such cases, the haptic feedbackcontroller 220 may be configured to automatically detect suchimpairments or restricted movement of the five fingers of the hand whenthe hand is placed on the haptic feedback interface 108. In someembodiment, the integrated sensors of the sensor cluster unit 216 may beused to detect such impairments or restricted movement of the fivefingers. The haptic feedback controller 220 may be configured todetermine a haptic feedback to be generated on the haptic feedbackinterface 108 in accordance with the detected impairment. For example,the area on which the plurality of different haptic cues is generatedmay be reduced or modified to suit the detected impairment. Theautomatic detection of the impairments may be done when the hapticfeedback device 102 is set in auto-mode. In some embodiments, the user110 may switch to manual mode, where the user 110 may provide input viathe haptic feedback interface 108 to indicate a specific impairment, andconfigure the generation of the plurality of different haptic cues basedon the provided input that indicates a particular impairment. In someembodiments, the functions of the control buttons, the haptic feedbackinterface 108, and the haptic feedback device 102 may be configurable bythe user 110 based on user inputs in a configuration mode. Theconfiguration mode may be switched “ON” using a configure button (notshown) provided in the haptic feedback device 102.

FIG. 4 illustrates a second exemplary scenario for implementation of theexemplary haptic feedback device of FIG. 2A for providing hapticsensation in a haptic gaming mode, in accordance with an embodiment ofthe disclosure. FIG. 4 is described in conjunction with elements fromFIGS. 1, 2A, 2B, and 3 . With reference to FIG. 4 , there is shown asecond exemplary scenario 400 that depicts generation of a plurality ofhaptic cues, such as a first set of haptic cues 406 a and 406 b and asecond set of haptic cues 408 a and 408 b, on the haptic feedbackinterface 108 of the haptic feedback device 102 in the haptic gamingmode. There is also shown a plurality of haptic input pens, such as afirst haptic input pen 402A and a second haptic input pen 402B, aplurality of speakers 404A, 404B, 404C, and 404D, the plurality ofhaptic elements 218, the mode selector wheel 312, the microphone 316,and the biometric sensor 216A.

In accordance with the second exemplary scenario 400, the user 110 mayselect the haptic gaming mode using the mode selector wheel 312 (FIG. 3). Based on the selection of the haptic gaming mode, a plurality of gameidentifiers (for example, a name or a particular game symbol) for aplurality of video games stored in the memory 212 of the haptic feedbackdevice 102, may be generated on the haptic feedback interface 108 or thelearning unit 314. The user 110 may select a video game from the storedplurality of video games to play a single user game or a multi-user gameof choice. The game selection may be done by a press on one of theplurality of game identifiers by use of one of the plurality of hapticinput pens, such as the first haptic input pen 402A. Alternatively, theuser 110 may provide a voice command to play a particular desired game.

In accordance with an embodiment, the haptic feedback device 102 mayalso include a plurality of other hardware control buttons (not shown),such as a power button to ON/OFF the haptic feedback device 102, a resetbutton to reset the generated plurality of haptic cues, on the hapticfeedback interface 108, one or more volume control buttons/wheels tocontrol audio output from the plurality of speakers 404A, 404B, 404C,and 404D, a mute button to disable audio output. The plurality ofspeakers 404A, 404B, 404C, and 404D may correspond to the one or moreaudio-output devices 224 (FIG. 2A).

In accordance with an embodiment, the haptic feedback controller 220 maybe configured to determine a haptic feedback for the selected gamingvideo (e.g. a multi-user golf game) based on the look-ahead buffer ofthe selected gaming video. The gaming video may be played in the hapticfeedback device 102. The haptic feedback may be determined for thegaming video, based on a detection and identification of object-types ofplurality of different objects in the gaming video and detection ofplurality of different motion associated with the plurality of objectsin the haptic gaming mode. The haptic feedback generator 222 may beconfigured to generate the first set of haptic cues 406 a and 406 b fora first player 410A and the second set of haptic cues 408 a and 408 bfor a second player 410B, based on the determined haptic feedback forthe selected gaming video (e.g. the multi-user golf game). The first setof haptic cues 406 a and 406 b and the second set of haptic cues 408 aand 408 b may be generated on the haptic feedback interface 108 usingthe plurality of haptic elements 218. The haptic cues 406 b and 408 bmay be movable haptic cues that represent a golf ball for each player.

The haptic feedback controller 220 may be configured to detect a hapticinput based on a push on the movable haptic cues, such as the hapticcues 406 b and 408 b. For example, the first player 410A may use thefirst haptic input pen 402A to pocket the haptic cue 406 b within thehaptic cue 406 a that represents a golf hole. The haptic cue 406 a maybe deformable haptic cue that is generated as a depression on thesurface of the haptic feedback interface 108 instead of a protrusion. Anexample of generation of a haptic cue as a depression (such as thedepression 240A) is also shown in FIG. 2B. Thus, when the first player410A pushes the haptic cue 406 b (a protrusion) with certain amount offorce towards the haptic cue 406 a (a depression) with an intent topocket (or place) the haptic cue 406 b within the haptic cue 406 a usingthe first haptic input pen 402A, the haptic feedback controller 220 maybe configured to detect the amount of force applied on the haptic cue406 b. The haptic feedback controller 220 may further detect a motionvector to estimate a direction of the applied force. A defined score maybe registered for the first player 410A based on proximity of the hapticcue 406 b to the haptic cue 406 a, as shown. A maximum score of “10Points” for example, may be assigned to the first player 410A, if thehaptic cue 406 b is placed within the haptic cue 406 b. Similarly, thesecond player 410B may push the haptic cue 408 b (a protrusion) withcertain amount of force towards the haptic cue 408 a (a depression) withan intent to pocket the haptic cue 408 b within the haptic cue 408 ausing the second haptic input pen 402B. A defined score may beregistered for the second player 410B based on proximity of the hapticcue 408 b to the haptic cue 408 a. The process of pushing the hapticcues 406 b and 408 b may be repeated, and each player may get specifiednumber of chances to push the haptic cues 406 b and 408 b. In this case,whoever scores the highest points in a total of five chances to push (orhit) the movable haptic cues assigned to each player, may win the game.

The movement of the movable haptic cues 406 b and 408 b may be generatedby the haptic feedback generator 222 as a series of protrusions in thedirection of the applied force based on the detected applied force andthe detected motion vector. In some embodiments, instead of actualmoving of the same haptic cue 406 b, the haptic cue 406 b may retract ata first time instant based on retraction of a haptic element of theplurality of haptic elements 218 that generated the haptic cue 406 b.Thereafter, another similar haptic cue of same shape and height mayprotrude in the direction of the applied force. This may appear asmovement of the haptic cue 406 b in the direction of the applied forcetowards the haptic cues 406 a on the haptic feedback interface 108, asshown in FIG. 4 . In some embodiments, the same movable haptic cue (suchas the haptic cue 408 b) may move towards the haptic cue 408 a in thedirection of the applied force. A sequential protrusion of the hapticelements in the direction of the applied force towards the haptic cues406 a may represent the movement, as shown in FIG. 4 , by a raised line412 a.

The haptic feedback controller 220 may be further configured to controloutput of audio feedback such that the audio feedback is in sync (i.e.synchronized) with the detected input, output, or different changes onthe haptic feedback interface 108 in accordance with the generatedplurality of haptic cues. For example, an audio feedback of “PerfectPocket, Player A have scored 10 points” may be generated when the hapticcue 406 b is placed within the haptic cue 406 a (i.e. pocketing of golfball) based on the push of the haptic cue 406 b by the player A usingthe first haptic input pen 402A.

In conventional devices, the input section to receive a haptic input isdifferent from the output section (in a conventional haptic userinterface) where the Braille output or other tactile forms of output aregenerated. Typically, the input section to receive haptic input is a6-keys or 8-keys Braille input. A separate section to receive input andprovide output, may be considered a rudimentary form of HMI, where agenerated haptic output may not be capable of receive a further feedbackon a particular touch-discernible haptic cue. In contrast, the sametactile surface area of haptic feedback interface 108 of the hapticfeedback device 102 acts both as the haptic input receiver and hapticoutput generator, where the user 110 may press or push a protrusion (ora bulge) generated on the haptic feedback interface 108 to provide thehaptic input related to a specific object to play the video game in thehaptic gaming mode. Based on the amount of pressure or force exerted bythe user 110 while touching the protrusion or pushing the protrusion onthe haptic feedback interface 108, the press or push may be considered ahaptic input by the haptic feedback controller 220. As the user 110 maysense the generated output by multiple-senses, such as sight(ophthalmoception), hearing (audioception), and touch (tactioception)concomitantly, a sighted player may play the same game in the hapticgaming mode with a user who has lost the sense of sight. Thus, thehaptic feedback device 102 may be operated by both a sighed user and avisually impaired user at the same time.

FIG. 5 illustrates a third exemplary scenario for implementation of theexemplary haptic feedback device of FIG. 2A for providing hapticsensation in an augmented gaming mode, in accordance with an embodimentof the disclosure. FIG. 5 is described in conjunction with elements fromFIGS. 1, 2A, 2B, 3, and 4 . With reference to FIG. 5 , there is shown athird exemplary scenario 500 that depicts generation of ahaptically-augmented feature, such as a haptic cue 506 a, in theaugmented gaming mode. There is shown the gaming suit 226B worn by theuser 110. There is further shown a gaming console 502. The gamingconsole 502 is configured to render a video game 504 on a display screen502A. The gaming console 502 may correspond to the external displaydevice, such as the display device 104 and the video game 504 maycorrespond to the video 112 (FIG. 1 ). In some embodiments, the hapticfeedback device 102 may be implemented as the gaming suit 226B, wherethe haptic feedback interface 108 is embedded in the inner surface ofthe gaming suit 226B. In this case, the haptic feedback interface 108may be a foldable or bendable layer integrated on the gaming suit 226Bsuch that the surface of the haptic feedback interface 108 is in contactwith the skin. The user 110 may sense the haptically-augmented featuregenerated on the haptic feedback interface 108 in hands-free mode. Insome embodiments, the haptic feedback device 102 may be a separatedevice which may be communicatively coupled to the gaming suit 226B(another type of haptic feedback device 102, where the haptic feedbackinterface 108 may be embedded in the gaming suit 226B as shown).

In accordance with the third exemplary scenario 500, the user 110 mayselect the augmented gaming mode using the mode selector 114 (FIG. 1 ).Based on the selection of the augmented gaming mode, a communicativecoupling may be established between the gaming suit 226B and the gamingconsole 502. The network interface 208 may be configured to access alook-ahead buffer of the upcoming scene of the video game 504 when acurrent scene may be displayed on the display screen 502A of the gamingconsole 502. The processing circuitry 210 may be configured to detect aplurality of different motion associated with the plurality of objectsin the upcoming scene of the video game 504 based on the look-aheadbuffer of the video game 504 played on the gaming console 502.

The haptic feedback controller 220 may be configured to determine ahaptic feedback for the upcoming scene of the video game 504 based onthe look-ahead buffer of the video game 504 and the detected pluralityof different motion associated with the plurality of objects. In someembodiments, the haptic feedback generator 222 may be configured togenerate the haptically-augmented feature, such as the haptic cue 506 a,on the haptic feedback interface 108. The haptically-augmented featuremay be generated in synchronization with the current scene played on thegaming console 502 (i.e. when the upcoming scene is rendered on thedisplay screen 502A of the gaming console 502). The haptically-augmentedfeature may be different from the visually perceptible elements in thecurrent scene of the video game 504. For example, the video game 504 maybe a jungle warfare game, where a 3D computer graphics model of the user110 may be generated in the video game 504, displayed on the displayscreen 502 a. Although the user 110 may visualize a moving object, suchas a snake climbing and swirling around the legs of the user 110, on thedisplay screen 502A, the user 110 may not experience the feel and warmthof the snake swirling. Such realistic haptic sensation may be providedto the user 110 by generation of the haptically-augmented feature, suchas the haptic cue 506 a, on the haptic feedback interface 108. Thehaptically-augmented feature, for example, the feel of the snakeclimbing and swirling around the user 110 in this case, may bediscernible by the user 110 wearing the gaming suit 226B. As the snakemoves from the legs towards the shoulders of the user 110 on the displayscreen 502A in the video game 504, the haptic cue 506 a may be generatedas an electric pulse that moves synchronous to the movement of the snakearound the user 110 on the display screen 502A providing hapticallyaugmented sense of the scene displayed on the display screen 502 a. Inadditional to the electric pulse, a sense of warmness and a grippingpressure may be generated in the route of the movement of the electricpulse, by the haptic feedback generator 222 in the gaming suit 226B. Theroute is shown by dotted points in the FIG. 5 . Thus, a combination ofdifferent modalities, such as the differential pressure-based modality,the differential temperature-based modality, the differential electricpulse-based modality, may be used concomitantly to provide extremerealism and enhanced user experience while playing the video game 504through the haptic feedback interface 108.

FIGS. 6A, 6B, and 6C collectively, depict a flow chart that illustratesa method for providing haptic sensation, in accordance with anembodiment of the disclosure. FIGS. 6A, 6B, and 6C are described inconjunction with elements from the FIGS. 1, 2A, 2B, 3, 4, and 5 . Asshown in FIG. 6A, the method of the flow chart 600 starts at 602 andproceeds to 604.

At 604, at least one of a haptic television mode, a haptic gaming mode,or an augmented gaming mode, may be selected using the mode selector114. The haptic feedback controller 220 may be configured to detect achange or a selection of a mode when the user 110 selects or changes amode using the mode selector 114.

At 606, a look-ahead buffer of an upcoming scene of the video 112 may bereceived in real time or near-real time. The network interface 208 maybe configured to receive the look-ahead buffer of the upcoming scene ofthe video 112 in real time or near-real time from the display device104. Other examples of the video 112 may be the video 304 (such as theTV program or the video game 504).

At 608, a plurality of different objects in the upcoming scene of thevideo 112 may be detected based on the look-ahead buffer of the video112. The processing circuitry 210 may be configured to detect theplurality of different objects in the upcoming scene of the video 112.

At 610, an object-type of each of the plurality of objects in theupcoming scene of the video 112 may be identified based the look-aheadbuffer of the video 112. The processing circuitry 210 may be configuredto identify the object-type of each of the plurality of objects in theupcoming scene of the video 112. Examples of the object-type mayinclude, but are not limited to a human being, an animal, a virtualcharacter, a famous personality, a point-of-interest, a vehicle-type(such as a car, a truck, a bicycle, a two-wheeler, a four-wheeler, andthe like), a living object, a non-living object, a moving object, astationary object, and other objects in the video 112.

At 612, a plurality of different motion associated with the plurality ofobjects in the upcoming scene of the video 112 may be detected. Theprocessing circuitry 210 may be configured to detect the plurality ofdifferent motion associated with the plurality of objects in theupcoming scene of the video 112 based on the look-ahead buffer of thevideo 112 played on the external display device (such as the displaydevice 104) or the haptic feedback device 102. For example, bothintra-motion and inter-motion associated with the plurality of objectsmay be detected. The intra-motion of an object refers to movement withinthe object, such as movement of different parts of an object while theobject is standing or located at a particular place. The inter-motionrefers to movement of objects with respect to each other.

At 614, a relative position and height of each of plurality of objectswith respect to each other may be determined. The processing circuitry210 may be configured to determine the relative position and height ofeach of plurality of objects with respect to each other.

At 616, speed and a direction of travel of each moving objects of theplurality of objects may be determined. The processing circuitry 210 maybe configured to determine the speed and the direction of travel of eachmoving objects of the plurality of objects.

At 618A, it may be checked whether the selected mode corresponds to thehaptic TV mode. In cases where the selected mode is the haptic TV mode,the control passes to 620A, else to 618B. At 618B, it may be checkedwhether the selected mode corresponds to the haptic gaming mode. Incases where the selected mode is the haptic gaming mode, the controlpasses to 620B, else to 618C. At 618C, it may be checked whether theselected mode corresponds to the augmented gaming mode. In cases wherethe selected mode is the augmented gaming mode, the control passes to620C, else the mode is set to the augmented gaming mode as default mode.

At 620A, a haptic feedback for the upcoming scene of the video 112 maybe determined based on the look-ahead buffer of the video 112, thedetected plurality of different motion associated with the plurality ofobjects, and the selected haptic TV mode. The control from 620A may passto 622. Similarly, at 620B, a haptic feedback for the upcoming scene ofthe video 112 may be determined based on the look-ahead buffer of thevideo 112, the detected plurality of different motion associated withthe plurality of objects, and the selected haptic gaming mode. Thecontrol from 620B may pass to 622. At 620C, a haptic feedback for theupcoming scene of the video 112 may be determined based on thelook-ahead buffer of the video 112, the detected plurality of differentmotion associated with the plurality of objects, and the selectedaugmented gaming mode. In some embodiments, the control may pass to 636.

At 622, a scaling factor may be determined based on an aspect ratio ofthe video 112 and defined haptic output area of the haptic feedbackinterface 108. The processing circuitry 210 may be configured todetermine the scaling factor based on the aspect ratio of the video 112and defined haptic output area of the haptic feedback interface 108.

At 624, a plurality of different haptic cues may be generated on thehaptic feedback interface 108 using the plurality of haptic elements218, based on the determined haptic feedback and the selected mode. Insome embodiments, the plurality of different haptic cues may include oneor more one or more movable haptic cues. The haptic feedback generator222 may be configured to generate the one or more movable haptic cues onthe haptic feedback interface 108 using the plurality of haptic elements218 in synchronization with a current scene played on the externaldisplay device (such as the display device 104) or the haptic feedbackdevice 102, based on the determined haptic feedback. The plurality ofdifferent haptic cues may be generated by a touch-discernible modality.The touch-discernible modality may include at least one of adifferential pressure-based modality, a differential temperature-basedmodality, a differential electric pulse-based modality, a differentialraised shape pattern-based modality, or a combination of differenttouch-discernible modalities.

In accordance with an embodiment, the processing circuitry 210 may beconfigured to select a first touch-discernible modality from a pluralityof touch-discernible modalities to generate a plurality of differenthaptic cues on the haptic feedback interface 108. The selection of thefirst touch-discernible modality may be based on learned userinteraction information. The learned user interaction information may bedetermined based on a historical analysis of usage pattern data of thehaptic feedback interface 108 by the learning engine provided in thememory 212. In some embodiments, a combination of differenttouch-discernible modalities may be selected based on the learned userinteraction information and a specified user-setting.

In a first example, the selected touch-discernible modality from theplurality of touch-discernible modalities to generate a plurality ofdifferent haptic cues on the haptic feedback interface 108, maycorrespond to a differential pressure-based modality. The plurality ofdifferent haptic cues may be generated as multi-level pressure ordifferent amount of pressure on the haptic feedback interface 108 by thehaptic feedback generator 222. For example, a first object of theplurality of objects in the video 112 may be discernible by generating ahaptic signal through one or more haptic elements of the plurality ofhaptic elements 218 as a first amount of pressure. This first amount ofpressure may be felt by the user 110 when the user 110 touches aspecific portion, for example, a first portion, of the haptic feedbackinterface 108. Similarly, for each position of different objects of theplurality of objects, a different amount of pressure may be generated onthe haptic feedback interface 108. Thus, the user 110 may feel differentamount of pressure at different points (or portions) on the hapticfeedback interface 108. The different amount of pressure enables theuser 110 (by touch on the haptic feedback interface 108) to non-visuallydiscern the relative positioning of the plurality of objects in thevideo 112 (or the video 304 (FIG. 3 ) or the video game 504 (FIG. 5 )).The different amount of pressure may correspond to the plurality ofdifferent haptic cues generated as multi-level pressure.

In a second example, the selected touch-discernible modality from theplurality of touch-discernible modalities to generate a plurality ofdifferent haptic cues on the haptic feedback interface 108, maycorrespond to a differential temperature-based modality. In accordancewith an embodiment, the plurality of different haptic cues may begenerated as different temperatures, for example, different combinationof hot and cold temperatures, on the haptic feedback interface 108 bythe haptic feedback generator 222. For each position of differentobjects of the plurality of objects, a different temperature level maybe generated on the haptic feedback interface 108 through one or morehaptic elements of the plurality of haptic elements 218. The differentlevel of temperature may enable the user 110 (by touch on the hapticfeedback interface 108 to non-visually discern the relative positioningof the plurality of objects including the user 110 in a video (such asthe video 112, 304, or the video game 504).

In a third example, the selected touch-discernible modality from theplurality of touch-discernible modalities to generate a plurality ofdifferent haptic cues on the haptic feedback interface 108, maycorrespond to a differential electric pulse-based modality. In thiscase, the plurality of different haptic cues may be generated asdifferent level of electric-pulses on the haptic feedback interface 108by the haptic feedback generator 222. For each position of differentobjects of the plurality of objects, a different level of electric-pulsemay be generated on the haptic feedback interface 108 through a hapticelement of the plurality of haptic elements 218. The different level ofelectric-pulses may enable the user 110 (by touch sense on the hapticfeedback interface 108) to non-visually discern the relative positioningof the plurality of objects in a video (such as the videos 112, 304, orthe video game 504). The different amount of electric-pulses maycorrespond to the plurality of different haptic cues generated asdifferent level of electric-pulses. Further, when an object of theplurality of objects moves in the video, an electric-pulse (e.g. thehaptic cue 506 a) may also be felt on the haptic feedback interface 122to be moving as a continuous line from one point of the haptic feedbackinterface 108 to another point to represent the movement and a directionof movement of the object in the video. The generation of electric-pulse(i.e. a touch-discernible cue) along a certain path on the hapticfeedback interface 108 may be synchronized to the actual movement of theobject in the video. This allows the user 110 to understand the path ofmovement of the object via the haptic feedback interface 108. Inaccordance with an embodiment, the synchronization of the generation ofelectric-pulse (i.e. a touch-discernible cue) along a certain path onthe haptic feedback interface 108 may be controlled based on thedetermined scaling factor. An example of the generation ofelectric-pulse along a certain path on the haptic feedback interface 108has been shown and described in FIG. 5 .

In a fourth example, the selected touch-discernible modality from theplurality of touch-discernible modalities to generate a plurality ofdifferent haptic cues on the haptic feedback interface 108, maycorrespond to a differential raised shape pattern-based modality. Inthis case, the plurality of different haptic cues may be generated as aplurality of protrusions of different shapes that are extended from thesurface of the haptic feedback interface 108. The plurality ofprotrusions of different shape, are shown, for example, in FIGS. 2B, 3,and 4 , as the plurality of different haptic cues. Each protrusion maybe a raised shape-pattern or a bulge that sticks out from at least oneor a group of haptic elements of the plurality of haptic elements 218 ofthe haptic feedback interface 108. The plurality of protrusionsrepresents the plurality of objects in the video 112. One shape may beassigned to one identified object-type of the plurality of objects ofthe video 112 to enable the user 110 to discern the object-type when theuser 110 touches a protrusion or depression of a defined shape. Thus,similar to the sighted people who use information about the features onthe surface of an object, like color, shading, or overall size, andshape, to recognize an object, the people who have lost the sense ofsight may also have the capability to identify an object based on atouch on the protrusion of a defined shape, where an association of aparticular shape with a particular object-type is learned by brain.

In accordance with an embodiment, the plurality of protrusions generatedon the haptic feedback interface 108 enables the user 110 to discern notonly the object-type but also a relative positioning of the plurality ofobjects and movement of one or more of the plurality of objects in thevideo 112. In accordance with an embodiment, the plurality ofprotrusions or depressions may be of same shapes. In such a case,although it may be relatively difficult to identify an object-type,however, the relative position and movement (if any) of each of theplurality of objects in the video 112 may be easily discernible by touchon the plurality of protrusions. Further, as the user 110 may hear soundemanated from the display device 104 when the video 112 is played.Hence, the user 110 may correlate the plurality of protrusions with theplurality of sounds to discern an object-type, and an action or movementwith respect to the plurality of objects. The haptic feedback generator222 may be configured to control the extending and the retracting of theplurality of protrusions or depressions by use of the plurality ofhaptic elements 218.

In accordance with an embodiment, the haptic feedback generator 222 maybe configured to control grouping of the plurality of haptic elements218 during extension or depression to represent a particular shape for aprotrusion or depression. In accordance with an embodiment, theprotrusion or the depression may be static or may be deformable. Thesame protrusion may have different meanings based on the deformation. Anexample of the deformation of the same protrusion (such as theprotrusion 230A to protrusions 230B, 230C, 230D, or 230E) is shown anddescribed, for example, in FIG. 2B. In accordance with an embodiment,the plurality of protrusions may be generated by application ofdifferent temperatures on different surface area of the haptic feedbackinterface 108. In such an embodiment, the haptic feedback interface 108may include a covering on the haptic feedback interface 108. Thecovering may be a polymer-based layer sensitive to temperature. Theplurality of the haptic elements 218 may be arranged as the array ofcylindrical tubes below the covering. In cases where, a localized hightemperature is generated through one or a group of the haptic elementsof the plurality of haptic elements 218, a bulge may appear on thecovering of the haptic feedback interface 108. Similarly, differentbulge portions may represent the plurality of protrusions. In caseswhere, a localized low temperature is generated through one or a groupof the haptic elements of the plurality of haptic elements 218, thebulge may disappear or subside or a depression may appear on thecovering of the haptic feedback interface 108. Similarly, differentbulge portions or concavities (or depressions) may represent theplurality of protrusions or depressions. Notwithstanding, the pluralityof protrusions and depressions may be generated by various methods, suchas by electro-chemical process, electro-mechanical process, withoutlimiting the scope of the disclosure. In accordance with an embodiment,the plurality of different haptic cues may be generated as differentlevel of electric-pulses or a different amount of pressure, such as painpoints (or pricking points) that may represent the positioning ormovement of the plurality of objects in the video 112 (or the video 304or the video game 504).

At 626, relative positioning of the plurality of different haptic cueson the haptic feedback interface 108 may be controlled to selectivelyreproduce the current scene played on the external display device (suchas the display device 104) or the haptic feedback device 102. Theselective reproduction of the current scene may be done based on aselection of the haptic television mode or the haptic gaming mode. Thehaptic feedback controller 220 in association with the haptic feedbackgenerator 222 may be configured to control the relative positioning ofthe plurality of different haptic cues on the haptic feedback interface108.

At 628, a deformation of a haptic cue of the generated plurality ofdifferent haptic cues on the haptic feedback interface 108 may becontrolled such that an intra-movement of an object of the plurality ofobjects may be discernible by tactioception. The haptic feedbackcontroller 220 in association with the haptic feedback generator 222 maybe configured to control deformation of one or more haptic cues of thegenerated plurality of different haptic cues on the haptic feedbackinterface 108 such that intra-movements of one or more objects of theplurality of objects may be discernible by tactioception.

At 630, movement of the one or more movable cues of the generatedplurality of different haptic cues may be controlled on the hapticfeedback interface 108 such that an inter-movement among a set of movingobjects of the plurality of objects may be discernible by tactioception.The haptic feedback generator 222 may be configured to control themovement of the one or more movable cues of the generated plurality ofdifferent haptic cues. In some embodiments, a rate-of-change of movementof the one or more movable haptic cues may be further controlled inaccordance with the determined scaling factor. The control may pass toend 638.

At 632, a haptic input may be detected on the haptic feedback interface108, based on a press or a push on at least one of the generatedplurality of different haptic cues that includes the one or more movablehaptic cues generated on the haptic feedback interface in the hapticgaming mode. The haptic feedback controller 220 may be configured todetect the haptic input on the haptic feedback interface 108 in thehaptic gaming mode.

At 634, output of an audio feedback by one or more audio output devicesmay be controlled to be in sync with the generated plurality of hapticcues. The control passes to 638.

At 636, at least a haptically-augmented feature may be generated on thehaptic feedback interface 108. The haptically-augmented feature may bedifferent from the visually perceptible elements in the current scene.The haptically-augmented feature may be generated based on the selectionof the augmented gaming mode. The haptically-augmented feature may bediscernible by tactioception using the haptic feedback interface 108. Inthe augmented gaming mode, the generated one or more movable haptic cuesmay correspond to a haptically-augmented reproduction of the currentscene of the video 112, such as a gaming video. The control passes toend 638 or returns to 604.

In accordance with an exemplary aspect of the disclosure, a system forproviding haptic sensation based on video is disclosed. The system mayinclude the haptic feedback device 102 (FIGS. 1, 2A, 2B, 3, 4, and 5 ),which may comprise the haptic feedback interface 108 (FIG. 1 )comprising the plurality of haptic elements 218 (FIG. 2A). The hapticfeedback device 102 may further comprise the processing circuitry 210configured to detect a plurality of different motion associated with aplurality of objects in an upcoming scene of a video (such as the video112) based on a look-ahead buffer of the video played on an externaldisplay device or the haptic feedback device 102. The haptic feedbackdevice 102 may further comprise the haptic feedback controller 220configured to determine a haptic feedback for the upcoming scene of thevideo based on the look-ahead buffer of the video and the detectedplurality of different motion associated with the plurality of objects.The haptic feedback device 102 may further comprise the haptic feedbackgenerator 222 configured to generate one or more movable haptic cues onthe haptic feedback interface 108 using the plurality of haptic elements218 in synchronization with a current scene played on the externaldisplay device or the haptic feedback device 102, based on thedetermined haptic feedback.

The present disclosure may be realized in hardware, or a combination ofhardware and software. The present disclosure may be realized in acentralized fashion, in at least one computer system, or in adistributed fashion, where different elements may be spread acrossseveral interconnected computer systems or the special-purpose device. Acomputer system or other special-purpose apparatus adapted to carry outthe methods described herein may be suited. The present disclosure maybe realized in hardware that comprises a portion of an integratedcircuit that also performs other functions.

The present disclosure may also be embedded in a computer programproduct, which comprises all the features that enable the implementationof the methods described herein, and which, when loaded in aspecial-purpose machine or computer system, is able to carry out thesemethods. Computer program, in the present context, means any expression,in any language, code or notation, of a set of instructions intended tocause a system with an information processing capability to perform aparticular function either directly, or after either or both of thefollowing: a) conversion to another language, code or notation; b)reproduction in a different material form.

While the present disclosure has been described with reference tocertain embodiments, it will be understood by those skilled in the artthat various changes may be made and equivalents may be substitutedwithout deviation from the scope of the present disclosure. In addition,many modifications may be made to adapt a particular situation ormaterial to the teachings of the present disclosure without deviationfrom its scope. Therefore, it is intended that the present disclosurenot be limited to the particular embodiment disclosed, but that thepresent disclosure will include all embodiments falling within the scopeof the appended claims.

What is claimed is:
 1. A haptic feedback device for providing hapticsensation, comprising: a haptic feedback interface that comprises aplurality of haptic elements; processing circuitry configured to detecta speed and a direction of travel associated with each moving object ofa plurality of moving objects in a first scene of a video, wherein thespeed and the direction of travel are detected based on a look-aheadbuffer of the video; a haptic feedback controller configured todetermine a haptic feedback for the first scene of the video based onthe look-ahead buffer of the video and the detected speed and thedetected direction of travel associated with the plurality of movingobjects; and a haptic feedback generator configured to generate at leastone movable haptic cue on the haptic feedback interface bysynchronization of the plurality of haptic elements with a second sceneof the video, wherein the at least one movable haptic cue is generatedbased on an aspect ratio of the video and an area of the haptic feedbackinterface associated with the determined haptic feedback.
 2. The hapticfeedback device according to claim 1, wherein the processing circuitryis further configured to detect a plurality of different objects in thefirst scene of the video, based on the look-ahead buffer of the video.3. The haptic feedback device according to claim 1, further comprises amode selector to select at least one of a haptic television mode, ahaptic gaming mode, or an augmented gaming mode.
 4. The haptic feedbackdevice according to claim 3, wherein the haptic feedback controller isfurther configured to selectively reproduce the second scene of thevideo on the haptic feedback interface based on a selection of thehaptic television mode.
 5. The haptic feedback device according to claim3, wherein the haptic feedback generator is further configured to:generate a plurality of different haptic cues that includes the at leastone movable haptic cue; and control a relative positioning of theplurality of different haptic cues on the haptic feedback interface toselectively reproduce the second scene played on an external displaydevice or a haptic feedback device based on a selection of the haptictelevision mode.
 6. The haptic feedback device according to claim 5,wherein the plurality of different haptic cues are generated by atouch-discernible modality that includes at least one of a differentialpressure-based modality, a differential temperature-based modality, adifferential electric pulse-based modality, or a differential raisedshape pattern-based modality.
 7. The haptic feedback device according toclaim 5, wherein the haptic feedback generator is further configured tocontrol deformation of a haptic cue of the generated plurality ofdifferent haptic cues on the haptic feedback interface such that anintra-movement of an object of a plurality of objects in the first sceneof the video is discernible by tactioception.
 8. The haptic feedbackdevice according to claim 5, wherein the haptic feedback generator isfurther configured to control movement of the at least one movablehaptic cue of the generated plurality of different haptic cues on thehaptic feedback interface such that an inter-movement among theplurality of moving objects of a plurality of objects is discernible bytactioception.
 9. The haptic feedback device according to claim 3,wherein the haptic feedback controller is further configured to detect ahaptic input on the haptic feedback interface, based on a press on atleast one of a plurality of different haptic cues that includes the atleast one movable haptic cue generated on the haptic feedback interfacein the haptic gaming mode.
 10. The haptic feedback device according toclaim 3, wherein the haptic feedback generator is further configured togenerate at least a haptically-augmented feature on the haptic feedbackinterface based on a selection of the augmented gaming mode, wherein thehaptically-augmented feature is different from visually perceptibleelements in the second scene, and wherein the haptically-augmentedfeature is discernible by tactioception.
 11. The haptic feedback deviceaccording to claim 1, wherein the generated at least one movable hapticcue corresponds to a haptically-augmented reproduction of the secondscene of the video.
 12. The haptic feedback device according to claim 1,further comprising a network interface to receive the look-ahead bufferof the first scene of the video in real time or near-real time from anexternal display device, wherein the external display device iscommunicatively coupled to the haptic feedback device.
 13. The hapticfeedback device according to claim 1, wherein the processing circuitryis further configured to identify an object-type of each of a pluralityof objects in the first scene based on the look-ahead buffer of thevideo.
 14. The haptic feedback device according to claim 1, wherein theprocessing circuitry is further configured to determine a scaling factorbased on the aspect ratio of the video and the area of the hapticfeedback interface, wherein a rate-of-change of movement of the at leastone movable haptic cue is controlled based on the scaling factor. 15.The haptic feedback device according to claim 1, wherein each of the atleast one movable haptic cue is generated as a protrusion of a definedshape-pattern extending from the haptic feedback interface, wherein atleast one motion from a plurality of different motion associated withthe plurality of moving objects in the first scene of the video isdiscernible based on a movement of the at least one movable haptic cueon the haptic feedback interface.
 16. A method for providing hapticsensation, comprising: in a haptic feedback device that comprises atleast a processing circuitry, a haptic feedback controller, a hapticfeedback generator, and a haptic feedback interface that includes aplurality of haptic elements: detecting, by the processing circuitry, aspeed and a direction of travel associated with each moving object of aplurality of moving objects in a first scene of a video, wherein thespeed and the direction of travel are detected based on a look-aheadbuffer of the video; determining, by the haptic feedback controller, ahaptic feedback for the first scene of the video based on the look-aheadbuffer of the video and speed and the detected direction of travelassociated with the plurality of moving objects; and generating, by thehaptic feedback generator, at least one movable haptic cue on the hapticfeedback interface by synchronization of the plurality of hapticelements with a second scene of the video, wherein the at least onemovable haptic cue is generated based on an aspect ratio of the videoand an area of the haptic feedback interface associated with thedetermined haptic feedback.
 17. The method according to claim 16,further comprising identifying, by the processing circuitry, a pluralityof different objects in the first scene of the video based on thelook-ahead buffer of the video.
 18. The method according to claim 16,further comprising selecting at least one of a haptic television mode, ahaptic gaming mode, or an augmented gaming mode.
 19. The methodaccording to claim 18, further comprising selectively reproducing, bythe haptic feedback controller, the second scene on the haptic feedbackinterface based on selection of the haptic television mode.
 20. Themethod according to claim 16, further comprising controlling, by thehaptic feedback generator, deformation of a haptic cue of a plurality ofdifferent haptic cues generated on the haptic feedback interface suchthat an intra-movement of an object of a plurality of objects in thefirst scene of the video is discernible by tactioception, wherein theplurality of different haptic cues includes the at least one movablehaptic cue.